Audiovisual sonifications: A design map for multisensory integration in data representation
نویسندگان
چکیده
In the field of data sonification, construction meaning is hampered by lack shared perceptual codes derived from common modes perception, as it happens for visual register. this paper, we re-organize knowledge previous experimental projects to build foundations future work in representation. This investigation aims identify patterns translation process different sensory modalities. To end, 80 audiovisual sonifications have been collected and analyzed through phenomenological analysis with goal recording correspondences. The resulting cross-sensory design map a synthesis analysis, has dual function. research domain, proposes testable hypotheses systematic approach sonification. practice, offers space that based on conventions aim standardize actions choices both sonification experts communication designers.
منابع مشابه
investigating the integration of translation technologies into translation programs in iranian universities: basis for a syllabus design in translation technology
today, information technology and computers are indispensable tools of any profession and translation technologies have become an indispensable part of translator’s workstation. with the increasing demands for high productivity and speed as well as consistency and with the rise of new demands for translation and localization, it is necessary for translators to be familiar with market demands an...
Heterogeneous Multisensory Integration in Robotics: a Data Representation Approach
A model suitable for the integration of heterogeneous multisensory information in robotics is proposed. This model is supported by a structured world representation which describes the contents of the physical workspace at multiple levels of abstraction through a hierarchy of oriented bounding boxes (OBBs). This hierarchical representation is implemented by means of a frame-based system. The la...
متن کاملSignal compatibility as a modulatory factor for audiovisual multisensory integration
The physical properties of the signals activating our senses are often correlated in nature; it would therefore be advantageous to exploit such correlations to better process sensory information. Stimulus correlations can be contingent and readily available to the senses (like the temporal correlation between mouth movements and vocal sounds in speech), or can be the results of the statistical ...
متن کاملDynamic Modeling Approaches for Audiovisual Speech Perception and Multisensory Integration
Multimodal information including auditory, visual and even haptic information is integrated during speech perception. Articulatory information provided by a talker‘s face enhances speech intelligibility in congruent and temporally coincident signals, and produces a perceptual fusion (e.g. the ―McGurk effect‖) when the auditory and visual signals are incongruent. This paper focuses on promising ...
متن کاملMultisensory integration in complete unawareness: evidence from audiovisual congruency priming.
Multisensory integration is thought to require conscious perception. Although previous studies have shown that an invisible stimulus could be integrated with an audible one, none have demonstrated integration of two subliminal stimuli of different modalities. Here, pairs of identical or different audiovisual target letters (the sound /b/ with the written letter "b" or "m," respectively) were pr...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of DRS
سال: 2022
ISSN: ['2398-3132']
DOI: https://doi.org/10.21606/drs.2022.380